United States Patent and Trademark Office 


UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 


APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


10/814,700 


03/30/2004 


758 7590 08/09/2005 

FENWICK&WEST LLP 
SILICON VALLEY CENTER - 
801 CALIFORNIA STREET 
MOUNTAIN VIEW, CA 94041 


Peter E. Hart 


20412-08455 


7223 


EXAMINER 


THOMPSON, JAMES A 


ART UNIT 


PAPER NUMBER 


2624 

DATE MAILED: 08/09/2005 


Please find below and/or attached an Office communication concerning this application or proceeding. 


PTO 90C (Rev 10/03) 



Application No. 

Applicant(s) 


Lz/T/C-t? /HUtlLIf/ OU//////a/ y 

10/814,700 

HART ET AL 


Examiner 

James A. Thompson 

Art Unit 

2624 



- 7/ie MAILING DATE of this communication appears on the cover sheet with the correspondence address -- 
Period for Reply 


A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

I) 13 Responsive to communication(s) filed on 30 March 2004 and 27 December 2004 , 
2a)D This action is FINAL. 2b)(3 This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) M Claim(s) 1-112 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) Q Claim(s) is/are allowed. 

6) E3 Claim(s) 1-112 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)13 The drawing(s) filed on 30 March 2004 is/are: a)l3 accepted or b)D objected to by the Examiner. 
Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

II) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)D Some * c)Q None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 


Attachment(s) 

1) S Notice of References Cited (PTO-892) 4) Q Interview Summary (PTO-413) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Pa P er No(s)/Mail Date. . 

3) E| Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5) □ Notice of Informal Patent Application (PTO-152) 

Paper No(s)/Mai! Date 12/27/04 . 6) □ Other: . 


U.S. Patent and Trademark Office 
PTOL-326 (Rev. 1-04) 


Office Action Summary 


Part of Paper No./Mail Date 20050802 


I t 

Application/Control Number: 10/814,700 
Art Unit: 2 624 


Page 2 


DETAILED ACTION 

Claim Rejections - 35 USC § 112 

1. The following is a quotation of the second - paragraph of 35 
U.S.C. 112: 

The specification shall conclude with one or more claims particularly 
pointing out and distinctly claiming the subject matter which the 
applicant regards as his invention. 

2. Claim 81 is rejected under 35 U.S.C. 112, second paragraph, 
as being indefinite for failing to particularly point out and 
distinctly claim the subject matter which applicant regards as 
the invention. 

Claim 81 recites the limitation "method of claim 1" in line 
1. There is insufficient antecedent basis for this limitation 
in the claim. 

Claim Rejections - 35 USC §102 

3. The following is a quotation of the appropriate paragraphs 
of 35 U.S.C. 102 that form the basis for the rejections under' 
this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or 
a foreign country or in public use or on sale in this country, more than one 
year prior to the date of application for patent in the United States. 

4. Claims 78, 92 and 112 are rejected under 35 U.S.C. 102(b) 
as being anticipated by Sugiyama (US Patent 5,633,723). 

Regarding claim 78: Sugiyama discloses receiving time- 
based media data from a media source (column 3, lines 12-17 of 
Sugiyama) ; receiving user input (column 3, lines 41-50 of 
Sugiyama) , the user input specifying a multimedia function to 
perform on the time-based media data (column 3, lines 57-63 of 
Sugiyama) ; performing the specified multimedia function on the 
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time-based media data (column 3, lines 57-63 of Sugiyama) to 
obtain an electronic image data (figure 4 and column 4, lines 
30-35 of Sugiyama) and associated print data (column 4, lines 
35-42 of Sugiyama) ; producing output on a printer from the 
associated print data from the processor (column 4, lines 35-42 
of Sugiyama) ; and producing an electronic output from the 
electronic image (column 4, lines 30-35 of Sugiyama) . 

Regarding claim 92: Sugiyama discloses selecting a range 
of video data in response to received input from the user 
(column 3, lines 45-48 of Sugiyama) . 

Regarding claim 112: Sugiyama discloses that the 
multimedia function includes applying a visual inspection 
function to the time-based media data (column 5, lines 56-65 of 
Sugiyama) . 

Claim Rejections - 35 USC §103 

5. The following is a quotation of 35 U.S.C. 103(a) which 
forms the basis for all obviousness rejections set forth in this 
Office action: 

(a) A patent may not be obtained though the invention is not identically 
disclosed or described as set forth in section 102 of this title, if the 
differences between the subject matter sought to be patented and the prior 
art are such that the subject matter as a whole would have been obvious at 
the time the invention was made to a person having ordinary skill in the 
art to which said subject matter pertains. Patentability shall not be 
negatived by the manner in which the invention was made. 

6. Claims 1-4, 7-8, 15-16, 18-23, 35, 42-43, 50, .62, 74, 79- 
81, 84-85, 93 and 95-100 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Sugiyama (US Patent 5,633,723) in view 
of Chino (US Patent 6,118,888). 

Regarding claim 1: Sugiyama discloses a printer (figure 1 
of Sugiyama) for printing (column 6, lines 19-26 of Sugiyama) 
time-based media data (column 3, lines 12-17 of Sugiyama), the 
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printer comprising a communication interface (figure 1(11) of 
Sugiyama) for receiving time-based media data from a media 
source (column 3, lines 12-17 of Sugiyama); a processor (figure 
1(15) of Sugiyama) for performing a multimedia function on the 
time-based media data (column 3, lines 57-63 of Sugiyama) to 
obtain an electronic image (figure 4 and column 4, lines 30-35 
of Sugiyama) and associated print data (column 4, lines 35-42 of 
Sugiyama); and a user interface (figure 1(20-25) of Sugiyama), 
communicatively coupled to the processor (column 3, lines 41-44 
of Sugiyama), including a display (figure 1(20) of Sugiyama) for 
providing data to the user (column 3, lines 45-50 of Sugiyama) 
and an input device (figure 1(21-25) of Sugiyama) for receiving 
data from the user (column 3, lines 41-50 of Sugiyama) . The 
collection of input keys (figure 1(21-25) of Sugiyama), along 
with the display (figure 1(20) of Sugiyama) which responds 
according to the inputs given by the collection of input keys 
(column 3, lines 41-50 of Sugiyama), forms the overall user 
interface . 

Sugiyama further discloses a first output device (figure 1 
(32-33) and column 7, lines 48-53 of Sugiyama) for receiving the 
associated print data from the processor and producing output on 
a printer (column 4, lines 35-42 of Sugiyama); and a second 
output device (figure 1(20) of Sugiyama) coupled to the 
processor for receiving the electronic image and producing an 
electronic output from the image (column 4, lines 30-35 of 
Sugiyama)- The head. driver (figure 1(32) of Sugiyama) and . 
thermal head (figure 1(33) of Sugiyama) together comprise the 
overall output printing device (column 7, lines 48-53 of 
Sugiyama) , which produces a printed output of the resultant 
video image data (column 4, lines 35-42 of Sugiyama) . As can be 
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seen in figure 1 of Sugiyama, the display is coupled to the 
processor through the monitor driver (figure 1(19) of Sugiyama), 
digital-to-analog converter (figure 1(18) of Sugiyama), and 
selector (figure 1(17) of Sugiyama). 

Sugiyama does not disclose expressly that the display of 
said user interface is a separate component from the second 
output' device . 

Chino discloses a user interface (figure 12 ( 305a, 306a) of 
Chino) for user input that includes a display (figure 4 and 
column 7, lines 48-54 of Chino) that is separate (column 15, 
lines 45-50 of Chino) from the other output devices (figure 12 
(308a) and column 15, lines 53-54 of Chino) . There are several 
different devices and types of devices used for producing an 
output of the resultant multimedia data (column 15, lines 53-54 
of Chino) . The display through which the user interacts with 
the overall system (figure 4 of Chino) is separate from the 
output devices (column 7, lines 48-54 of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely multimedia image data processing 
and control. At the time of the invention, it would have been 
obvious to a person of ordinary skill in the art to have a 
separate user interface for the user, as taught by Chino. The 
motivation for doing so would have been to allow the user to 
smoothly communicate with the system (column 7, lines 58-64 of 
Chino) . Therefore, it would have been obvious to combine Chino 
with Sugiyama to obtain the invention as specified in claim 1. 

Regarding claims 2 and 79: Sugiyama does not disclose 
expressly that said multimedia function includes selecting a 
range of audio data in response to received input from the user. 
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Chino discloses selecting a range of audio data in response 
to received input from the user (column 14, lines 8-18 of 
Chino). Only the audio data that is intended to' be input by the 
user is input in response to the appropriate user input, while 
any other noise. is ignored by the system (column 14, lines 8-18 
of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of . 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
allow the user to input only a specifically desired range of 
audio data, as taught by Chino. The motivation for doing so 
would have been to prevent unintended and erroneous audio input 
(column 14, lines 10-11 of Chino) . Therefore, it would have 
been obvious to combine Chino with Sugiyama to obtain the 
invention as specified in claims 2 and 79. 

Regarding claims 3 and 80: Sugiyama does not disclose 
expressly that said multimedia function includes applying audio 
event detection to the time-based media data. 

Chino discloses applying audio event detection to the time- 
based media data (column 14, lines 8-18 of Chino) . The system 
detects when audio data is intended to be input by the user, 
while any other noise is ignored by the system (column 14, lines 
8-18 of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
detect audio data events, as taught by Chino. The motivation 
for doing so would have been to prevent unintended and erroneous 
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audio input (column 14, lines 10-11 of Chino) . Therefore, it 
would have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 3 and 80. 

Regarding claims 4 and 81: Sugiyama does not disclose 
expressly that the multimedia function includes determining a 
confidence level associated with the audio event detection. 

Chino discloses that an audio event is detected (column 14, 
lines 8-11 of Chino) based on specific criteria that are to be 
met to the satisfaction of a computer automated system (column 
14, lines 11-19 of Chino) . Thus, a confidence level associated 
with the audio event detection is determined. 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
detect audio data events based on a determined confidence level, 
as taught by Chino. The motivation for doing so would have been 
to prevent unintended and erroneous audio input (column 14, 
lines 10-11 of Chino) . Therefore, it would have been obvious to 
combine Chino with Sugiyama to obtain the invention as specified 
in claims 4 and 81. 

Regarding claims 7 and 84: Sugiyama does not disclose 
expressly that said multimedia function includes applying a 
sound source localization function to the time-based media data. 

Chino discloses applying a sound source localization 
function to time-based media data (column 13, lines 5-14 of 
Chino) . By using the gaze object detection portion of the 
multi-modal interface apparatus, the audio sound source 
localization is determined. 
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Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
configure the user interface to apply a sound source 
localization function to the time-based media data, as taught by 
Chino. The motivation for doing so would have been to ensure 
that user input is intended, and the user is not speaking to 
someone else (column 1, lines 52-58 of Chino) . Therefore, it 
would have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 7 and 84. 

Regarding claims 8 and 85: Sugiyama does not disclose 
expressly that said multimedia function includes applying audio 
event detection to the time-based media data. 

Chino discloses applying audio event detection to the time- 
based media data (column 14, lines 8-18 of Chino) . The system 
detects when audio data is intended to be input by the user, 
while any other noise is ignored by the system (column 14, lines 
8-18 of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
detect audio data events, as taught by Chino. The motivation 
for doing so would have been to prevent unintended and erroneous 
audio input (column 14, lines 10-11 of Chino) . Therefore, it 
would have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 8 and 85. 
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Regarding claim 15: Sugiyama discloses selecting a range 
of video data in response to received input from the user 
(column 3, lines 45-48 of Sugiyama) . 

Regarding claims 16 and 93: Sugiyama does not disclose 
expressly that said multimedia function includes applying a 
video event detection function to the time-based media data. 

Chino discloses applying a video event detection function 
to the time-based media data (column 7 , lines 33-40 of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
configure the user interface to apply a video event detection 
function to the time-based media data, as taught by Chino. The 
motivation for doing so would have been to be able to apply user 
gestures as another form of data input (column 7, lines 38-45 of 
Chino) . Therefore, it would have been obvious to combine Chino 
with Sugiyama to obtain the invention as specified in claims 16 
and 93. 

Regarding claims 18 and 95: Sugiyama does not disclose 
expressly that said multimedia function includes applying a face 
detection function to the time-based media data. 

Chino discloses applying a face detection function to time- 
based media data (figure 20(406) and column 24,. lines 25-27 of 
Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply a face detection function to time-based media data, as 
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taught by Chino. The motivation for doing so would have been to 
determine which particular user corresponds to the current user 
by recognition of the current user's face (column 26, lines 20- 
22 of Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claims 18 and 95. 

Further regarding claims 19 and 96: Chino discloses 
applying a clustering function to the time-based media data to 
merge multiple instances of a face into a representative image 
(column 26, lines 1-12 of Chino) . 

Regarding claims 20 and 97 : Sugiyama does not disclose 
expressly that said multimedia function includes applying a face 
recognition function to the time-based media data. 

Chino discloses applying a face recognition function to 
time-based media data (figure 20(406) and column 24, lines 25-27 
of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply a face recognition function to time-based media data, as 
taught by Chino. The motivation for doing so would have been to 
determine which particular user corresponds to the current user 
by recognition of the current user's face (column 26, lines 20- 
22 of Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claims 20 and 97. 

Regarding claims 21 and 98: Sugiyama does not disclose 
expressly that the multimedia function includes applying an 
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optical character recognition function to the time-based media 
data. 

Chino discloses applying an optical character recognition 
function to time-based media data (figure 3(102j) and column 7, 
lines 14-18 of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply an optical character recognition function to time-based 
media data, as taught by Chino. The suggestion for doing so 
would have been that character recognition from an electronic 
pen is simply another useful electronic means to input data into 
a computerized system (figure 3 and column 7, lines 2-11 of 
Chino) . Therefore, it would have been obvious to combine Chino 
with Sugiyama to obtain the invention as specified in claims 21 
and 98. 

Further regarding claims 22 and 99: Chino discloses 
applying a clustering function to the time-based media data to 
merge similar results of the optical character recognition 
(column 7, lines 15-21 of Chino) . The particular language input 
by the user, such as German, Russian and Chinese, which use 
different character sets, is detected. The particular language 
determines the cluster of characters to use in optical character 
recognition (column 7, lines 15-21 of Chino) . 

Regarding claims 23 and 100: Sugiyama does not disclose 
expressly that the multimedia function includes applying a 
motion analysis function to the time-based media data. 
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Chino discloses applying a motion analysis function to 
time-based media data (figure 3(102f) and column 7, lines 33-38 
of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply a motion analysis function to time-based media data, as 
taught. by Chino. The suggestion for doing so would have been 
that detection of a user's motion and gestures is simply another 
useful electronic means to input data into a computerized system 
(figure 3 and column 7, lines 2-11 of Chino). Therefore, it 
would have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 23 and 100. 

Regarding claim 35: Sugiyama discloses that the multimedia 
function includes applying a visual inspection function to the 
time-based media data (column 5, lines 56-65 of Sugiyama) . 

Regarding claim 42: Sugiyama does not disclose expressly 
that said user interface is configured to allow a user to 
control audio sound localization hardware. 

Chino discloses controlling audio sound localization 
hardware (column 13, lines 5-14 of Chino) . By using the gaze 
object detection portion of the multi-modal interface apparatus, 
the audio sound localization is determined. 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
configure said user interface to allow a user to control audio 
sound localization hardware, as taught by Chino. The motivation 
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for doing so would have been to ensure that user input is 
intended, and the user is not speaking to someone else (column 
1, lines 52-58 of Chino) . Therefore, it would have been obvious 
to combine Chino with Sugiyama to obtain the invention as 
specified in claim. 42. 

Regarding claim 43: Sugiyama does not disclose expressly 
that said user interface is configured to allow a user to 
control motion detection hardware. 

Chino discloses controlling motion detection hardware 
(figure 3(102f) and column 7, lines 33-38 of Chino). 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would ■ 
have been obvious to a person of ordinary skill in the art to 
configure said user interface to allow a user to control motion 
detection hardware, as taught by Chino. The suggestion for 
doing so would have been that detection of a user's motion and 
gestures is simply another useful electronic means to input data 
into a computerized system (figure 3 and column 7, lines 2-11 of 
Chino) . Therefore, it would have been obvious to combine Chino 
with Sugiyama to obtain the invention as specified in claim 43. 

Regarding claim 50: Sugiyama discloses that the processor 
is further configured to display results of the multimedia 
function on the display of the user interface (column 4, lines 
30-35 of Sugiyama) . 

Regarding claim 62: Sugiyama does not disclose expressly 
that the second output device is audio sound localization 
hardware . 

Chino discloses controlling as an output device audio sound 
localization hardware (column 13, lines 5-14 of Chino) . By 
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using the gaze object detection portion of the multi-modal 
interface apparatus, the audio sound localization is determined. 

Sugiyama and Chino are 4 containable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
output audio data through audio sound localization hardware, as 
taught by Chino. The motivation for doing so would have been to 

7 

ensure that user input is intended, and the user is not speaking 
to someone else (column 1, lines 52-58 of Chino) . Therefore, it 
would have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claim 62. 

Regarding claim 74: Sugiyama does not disclose expressly 
that the second output device is hardware for capturing data 
from an electronic pen. 

Chino discloses controlling as an output device hardware 
for capturing data from an electronic pen (figure 3(102i) and 
column 7, lines 14-16 of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
digital data. At the time of the invention, it would have been 
obvious to a person of ordinary skill in the art to use hardware 
for capturing data from an electronic pen, as taught by Chino. 
The suggestion for doing so would have been that an electronic 
pen is simply another useful output device that provides digital 
data a user may wish to obtain (figure 3 and column 6, lines 66- 
67 of Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claim 74 . 
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7. Claims 5-6 and 82-83 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Sugiyama (US Patent 5,633,723) in view 
of Chino (US Patent 6,118,888) and Kametani (US Patent 

5, 091, 948) . 

Regarding claims 5 and 82: Sugiyama in view of Chino does 
not disclose expressly that said multimedia function includes 
applying a speaker segmentation function to the time-based media 
data . 

Kametani discloses applying a speaker segmentation function 
to time-based media data (figure 3d and column 5, lines 5-9 and 
lines 29-33 of Kametani) . 

Sugiyama in view of Chino is combinable with Kametani 
because they are from the same field of endeavor, namely the 
control and processing of time-based media data. At the time of 
the invention, it would have been obvious to a person of 
ordinary skill in the art to apply a speaker segmentation 
function to said time-based media data, as taught by Kametani. 
The motivation for doing so would have been that using a speaker 
segmentation function extracts parameters that uniquely identify 
a speaker, thus improving the level of speaker discrimination 
(column 5, lines 29-35 of Kametani) . Therefore, it would have 
been obvious to combine Kametani with Sugiyama in view of Chino 
to obtain the invention as specified in claims 5, 13, 82 and 90. 

Further regarding claims 6/1, 6/5, and 83/78, 83/82: 
Kametani discloses applying a speaker recognition function to 
said time-based media data (column 5, lines 29-35 of Kametani) . 

8. Claims 9-11, 14, 86-88 and 91 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 5,633,723) 
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in view of Chino (US Patent 6,118,888) and Halverson (US Patent 
Application Publication 2002/0101513 Al). 

Regarding claims 9 and 86: Sugiyama in view of Chino does 
not disclose expressly that said multimedia function includes 
applying a speech recognition function to said time-based media 
data . 

Halverson discloses applying a speech recognition function 
to time-based media data (para. 24, lines 2-5 and para.. 25, 
lines 21-23 of Halverson) . 

Sugiyama in view of Chino is combinable with Halverson 
because they are from the same field of endeavor, namely the 
control and processing of time-based media data. At the time of 
the invention, it would have been obvious to a person of 
ordinary skill in the art to apply a speech recognition 
function, as taught by Halverson. The motivation for doing so 
would have been that speech is a useful and natural form of 
human input (para. 25, lines 11-14 of Halverson) . Therefore, it 
would have been obvious to combine Halverson with Sugiyama in 
view of Chino to obtain the invention as specified in claims 9 
and 86. 

Further regarding claims 10 and 87: Halverson discloses 
applying a profile analysis function to the time-based media 
data (para. 23, lines 4-7 of Halverson) . 

Regarding claims 11 and 88: Sugiyama does not disclose 
expressly that said multimedia function includes applying audio 
event detection to the time-based media data. 

Chino discloses applying audio event detection to the time- 
based media data (column 14, lines 8-18 of Chino) . The system 
detects when audio data is intended to be input by the user, 
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while any other noise is ignored by the system (column 14, lines 
8-18 of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
detect audio data events, as taught by Chino. The motivation 
for doing so would have been to prevent unintended and erroneous 
audio input (column 14, lines 10-11 of Chino) . Therefore, it 
would have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 11 and 88. 

Regarding claims 14 and 91: Sugiyama does not disclose 
expressly that said multimedia function includes applying a 
sound source localization function to the time-based media data. 

Chino discloses applying a sound source localization 
function to time-based media data (column 13, lines 5-14 of 
Chino) . By using the gaze object detection portion of the 
multi-modal interface apparatus, the audio sound source 
localization is determined. 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
configure the user interface to apply a sound source 
localization function to the time-based media data, as taught by 
Chino. The motivation for doing sa would have been to ensure 
that user input is intended, and the user is not speaking to 
someone else (column 1, lines 52-58 of Chino) . Therefore, it 
would have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 14 and 91. 
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9. Claims 12-13 and 89-90 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Sugiyama (US Patent 5,633,723) in 
view of Chino (US Patent 6,118,888), Halverson (US Patent 
Application Publication 2002/0101513 Al) and Kametani (US Patent 
5,091, 948). 

Regarding claims 12 and 89: Sugiyama in view of Chino and 
Halverson does not disclose expressly that said multimedia 
function includes applying a speaker recognition function to 
said time-based media data. 

Kametani discloses applying a speaker recognition function 
to said time-based media data (column 5, lines 29-35 of 
Kametani) . 

Sugiyama in view of Chino and Halverson is combinable with 
Kametani because they are from the same field of endeavor, 
namely the control and processing of time-based media data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to apply a speaker 
recognition function to said time-based media data, as taught by 
Kametani. The motivation for doing so would have been that 
using a speaker recognition function extracts parameters that 
uniquely identify a speaker, thus improving the level of speaker 
discrimination (column 5, lines 29-35 of Kametani) . Therefore, 
it would have been obvious to combine Kametani with Sugiyama in 
view of Chino and Halverson to obtain the invention as specified 
in claims 12 and 89. 

Regarding claims 13 and 90: Sugiyama in view of Chino and 
Halverson does not disclose expressly that said multimedia 
function includes applying a speaker segmentation function to 
the time-based media data. 
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Kametani discloses applying a speaker segmentation function 
to time-based media data (figure 3d and column 5, lines 5-9 and 
lines 29-33 of Kametani) . 

Sugiyama in view of Chino and Halverson is combinable with 
Kametani because they are from the same field of endeavor, 
namely the control and processing of time-based media data. At 
the time of the invention, it would have been obvious to a 
person of ordinary skill in the art to apply a speaker 
segmentation function to said time-based media data, as taught 
by Kametani. The motivation for doing so would have been that 
using a speaker segmentation function extracts parameters that 
uniquely identify a speaker, thus improving the level of speaker 
discrimination (column 5, lines 29-35 of Kametani) . Therefore, 
it would have been obvious to combine Kametani with Sugiyama in 
view of Chino and Halverson to obtain the invention as specified 
in claims 13 and 90. 

10. Claims 17, 76 and 94 are rejected under 35 U.S.C. 103 (a) as 
being unpatentable over Sugiyama (US Patent 5,633,723) in view 
of Chino (US Patent 6,118,888) and Krumm (US Patent 6,611,622 
Bl) . 

Regarding claims 17 and 94: Sugiyama in view of Chino does 
not disclose expressly that said multimedia function includes 
applying a color histogram analysis function to said time-based 
media data. 

Krumm discloses applying a color histogram analysis 
function to time-based media data (figure 2(202) and column 8, 
lines 46-47 of Krumm) . 

Sugiyama in view of Chino is combinable with Krumm because 
. they are from the same field of endeavor, namely control and 
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processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of ordinary 
skill in the art to apply a color histogram analysis function to 
the time-based media data, as taught by Krumm. The motivation 
for doing so would have been to better identify people or 
objects in scenes generated subsequent to a model scene (column 
8, lines 53-58 of Krumm) . Therefore, it would have been obvious 
to combine Krumm with Sugiyama in view of Chino to obtain the 
invention as specified in claims 17 and 94. 

Regarding claim 76: Sugiyama in view of Chino does not 
disclose expressly that the second output device is a flash 
memory device. 

Krumm discloses outputting computer data to a flash memory 
device (column 7, lines 27-33 of Krumm) . 

Sugiyama in view of Chino is combinable with Krumm because 
they are from the same field of endeavor, namely control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of ordinary 
skill in the art to have the second output device be the flash 
memory device taught by Krumm. The suggestion for doing so 
would have been that a flash memory device is one of many 
possible useful output devices available to those of ordinary 
skill in the art (column 7, lines 27-36 of Krumm) . Therefore, 
it would have been obvious to combine Krumm with Sugiyama in 
view of Chino to obtain the invention as specified in claim 76. 

11. Claims 24/1, 24/23 and 101/100 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 5,633,723) 
in view of Chino (US Patent 6,118,888) and Kim (US Patent 
6, 594, 377 Bl) . 
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Regarding claims 24/1, 24/23, and 101/100: Sugiyama in 
view of Chino does not disclose expressly that said multimedia 
function includes a distance estimation function to the time- 
based media data. 

Kim discloses applying a distance estimation to image media 
data (column 3, lines 33-36 of Kim) . 

Sugiyama in view of Chino is combinable with Kim because 
they are from the same field of endeavor, namely the control and 
processing of media data. At the time of the invention, it 
would have been obvious to a person of ordinary skill in the art 
to apply distance estimation, as taught by Kim, to the time- 
based media data. The motivation for doing so would have been 
to determine if the user, or a relevant part of the user, is 
within the required operational range (column 4, lines 28-34 of 
Kim) . Therefore, it would have been obvious to combine Kim with 
to Sugiyama in view of Chino obtain the invention as specified 
in claims 24/1, 24/23 and 101/100. 

12. Claim 101/78 is rejected under 35 U.S. C. 103(a) as being 
unpatentable • over Sugiyama (US Patent 5,633,723) in view of Kim 
(US Patent 6, 594, 377 Bl) . 

Regarding claim 101/78: Sugiyama does not disclose 
expressly that said multimedia function includes a distance 
estimation function to the time-based media data. 

Kim discloses applying a distance estimation to image media 
data (column 3, lines 33-36 of Kim) . 

Sugiyama and Kim are combinable because they are from the 
same field of endeavor, namely the control and processing of 
media data. At the time of the invention, it would have been 
obvious to a person of ordinary skill in the art to apply 
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distance estimation, as taught by Kim, to the time-based media 
data. The motivation for doing so would have been to determine 
if the user, or a relevant part of the user, is within the 
required operational range (column 4, lines 28-34 of Kim) . 
Therefore, it would have been obvious to combine Kim with 
Sugiyama to obtain the invention as specified in claim 101/78. 

13. Claims 25-31 and 102-108 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 5,633,723) 
in view of Chino (US Patent 6,118,888) and Krumm (US Patent 
6, 611, 622 Bl) . 

Regarding claims 25 and 102: Sugiyama in view of Chino 
does not disclose expressly that said multimedia function 
includes applying a foreground/background segmentation function 
to said time-based media data. 

Krumm discloses applying a foreground/background 
segmentation function to time-based media data (column 10, lines 
13-15 of Krumm) . 

Sugiyama in view of Chino is combinable with Krumm because 
they are from the same field of endeavor, namely control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of ordinary 
skill in the art to apply a foreground/background segmentation 
function to the time-based media data, as taught by Krumm. The 
motivation for doing so would have been that the foreground 
segment is needed to further segment for the purpose of 
identifying people and objects in an image (column 10., lines 15- 
18 of Krumm) . Therefore, it would have been obvious to combine 
Krumm with Sugiyama in view of Chino to obtain the invention as 
specified in claims 25 and 102. 
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Regarding claims 26 and 103: Sugiyama in view of Chino 
does not disclose expressly that said multimedia function 
includes applying a scene segmentation function to said time- 
based media data. 

Krumm discloses applying a scene segmentation function to 
time-based media data (column 10, lines 15-18 of Krumm) . 

Sugiyama in view of Chino is combinable with Krumm because 
they are from the same field of endeavor, namely control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to' a person of ordinary 
skill in the art to apply a scene segmentation function to the 
time-based media data, as taught by Krumm. The motivation for 
doing so would have been that segmenting the foreground scene is 
needed to identify people and objects in an image (column 10, 
lines 15-18 of Krumm) . Therefore, it would have been obvious to 
combine Krumm with Sugiyama in view of Chino to obtain the 
invention as specified in claims 26 and 103. 

Regarding claims 27 and 104: Sugiyama does not disclose 
expressly that said multimedia function includes applying a face 
recognition function to the time-based media data. 

Chino discloses applying a face recognition function to 
time-based media data (figure 20(406) and column 24, lines 25-27 
of Chino) . 

Sugiyama and Chino are combinable because they are from, the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply a face recognition function to time-based media data, as 
taught by Chino. The motivation for doing so would have been to 
determine which particular user corresponds to the current user 
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by recognition of the current user's face (column 26, lines 20- 
22 of Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claims 27 and 104. 

Regarding claims 28 and 105: Sugiyama does not disclose 
expressly that said multimedia function includes applying a face 
detection function to the time-based media data. 

Chino discloses applying a face detection function to time- 
based media data (figure 20(406) and column 24, lines 25-27 of 
Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply a face detection function to time-based media data, as 
taught by Chino. The motivation for doing so would have been to 
determine which particular user corresponds to the current user 
by recognition of the current user's face (column 26, lines 20- 
22 of Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama. to obtain the invention as specified in 
claims 28 and 105. 

Regarding claims 29 and 106: Sugiyama does not disclose 
expressly that the multimedia function includes applying an 
optical character recognition function to the time-based media 
data . 

Chino discloses applying an optical character recognition 
function to time-based media data (figure 3(102j) and column 7, 
lines 14-18 of Chino) . 

Sugiyama and Chino. are combinable because- they are from the 
same field of endeavor, namely the control and processing of 
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time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply an optical character recognition function to time-based 
media data, as taught by Chino. The suggestion for doing so 
would have been that character recognition from an electronic 
pen is simply another useful electronic means to input data into 
a computerized system (figure 3 and column 7, lines 2-11 of 
Chino) . Therefore, it would have been obvious to combine Chino 
with Sugiyama to obtain the invention as specified in claims 29 
and 10 6. 

Regarding claims 30 and 107: Sugiyama does not disclose 
expressly that said multimedia function includes applying a face 
recognition function to the time-based media data. 

Chino discloses applying a face recognition function to 
time-based media data (figure 20(406) and column 24, lines 25-27 
of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply a face recognition function to time-based media data, as 
taught by Chino. The motivation for doing so would have been to 
determine which particular user corresponds to the current user 
by recognition of the current user's face (column 26, lines 20- 
22 of Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claims 30 and 107. 

Regarding claims 31 and 108: Sugiyama does not disclose 
expressly that said multimedia function includes applying a face 
detection function to the time-based media data. 
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Chino discloses applying a face detection function to time- 
based media data (figure 20(406) and column 24, lines 25-27 of 
Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply a face detection function to time-based media data, as 
taught by Chino. The motivation for doing so would have been to 
determine which particular user . corresponds to the current user 
by recognition of the current user's face (column 26, lines 20- 
22 of Chino) . Therefore, it would have been obvious to combine 
Chino with Sugiyama to obtain the invention as specified in 
claims 31 and 108. 

14. Claims 32-34 and 109-111 are rejected under 35 U.S.C. 
103(a) as being unpatentable, over Sugiyama (US Patent 5, 633, 723) 
in view of Chino (US Patent 6,118,888) and Gerber (US Patent 
5, 568, 406) . 

Regarding claims 32 and 109: Sugiyama in view of. Chino 
does not disclose expressly that said multimedia function 
includes applying an automobile recognition function to said 
time-based media data. 

Gerber discloses applying an automobile recognition 
function to time-based media data (column 8, lines 42-45 of 
Gerber) . 

Sugiyama in view of Chino is combinable with Gerber because 
they are from the same field of endeavor, namely the control and 
processing of time-based image data. At the time of the 
invention, it would have been obvious to a person of ordinary 
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skill in the art to apply an automobile recognition function to 
said time-based media data, as taught by Gerber. The motivation, 
for doing so would have been to determine from the time-based 
media data whether or not the automobile in the time-based media 
data is stolen (column 8, lines 45-46 of Gerber) . Therefore, it 
would have been obvious to combine Gerber with Sugiyama in view 
of Chino to obtain the invention as specified in claims 32 and 
109. 

Regarding claims 33 and 110: Sugiyama does not disclose 
expressly that the multimedia function includes applying a 
motion analysis function to the time-based media data, 

Chino discloses applying a motion analysis function to 
time-based media data (figure 3(102f) and column 7, lines 33-38 
of Chino) . 

Sugiyama and Chino are combinable because they are from the 
same field of endeavor, namely the control and processing of 
time-based media data. At the time of the invention, it would 
have been obvious to a person of ordinary skill in the art to 
apply a motion analysis function to time-based media data, as 
taught by Chino. The suggestion for doing so would have been 
that detection of a user's motion and gestures is simply another 
useful electronic means to input data into a computerized system 
(figure 3 and column 7, lines 2-11 of Chino) . Therefore, it 
would have been obvious to combine Chino with Sugiyama to obtain 
the invention as specified in claims 33 and 110. 

Regarding claims 34 and 111: Sugiyama in view of Chino 
does not disclose expressly that said multimedia function 
includes applying a license plate recognition function to said 
time-based media data. 
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Gerber discloses applying a license plate recognition 
function to time-based media data (column 3, lines 42-47 and 
lines 63-64 of Gerber) . 

Sugiyama in view of Chino is combinable with Gerber because 
they are from the same field of endeavor, namely the control and 
processing of time-based image data. At the time of the 
invention, it would have been obvious to a person of ordinary 
skill in the art to apply a license plate recognition function 
to said time-based media data, as taught by Gerber. The 
motivation for doing so would have been to determine from the 
time-based media data whether or not the automobile in the time- 
based media data is stolen (column 1, line 66 to column 2, line 
2 of Gerber) . Therefore, it would have been obvious to combine 
Gerber with Sugiyama in view of Chino to obtain the invention as 
specified in claims 34 and 111. 

15. Claims 36-39, 44-45, 47, 51-58, 63, 65, 73 and 75 are 
rejected under 35 U.S.C. 103(a) as being unpatentable over 
Sugiyama (US Patent 5,633,723) in view of Chino (US Patent 
6,118,888) and Hymel (US Patent Application Publication 
2003/0220988 Al ) . 

Regarding claims 36-39, 44-45 and 47: Sugiyama in view of 
Chino does not disclose expressly that said user interface is 
configured to allow a user to control a compact disc (CD) 
device, a digital video disc (DVD) device, an audio tape device, 
a video tape device, a MIDI player, a cellular telephone, and/or 
a world wide web display. 

Hymel discloses a user interface configured to allow a user 
to control (para. 10, lines 1-5 of Hymel) a compact disc (CD) 
device (para. 10, lines 14-15 and lines 19-20 of Hymel), a 
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digital video disc (DVD) device (para. 10, lines 14-15 and lines 
20-21 of Hymel), an audio tape device (audio tape device is a 
type of audio player, MP3 player is merely an example) (para. 
10, lines 14-15 and line 19 of Hymel), a video tape device 
(digital camcorder, . which, as is well-known in the art, uses a 
digital video (DV) cassette tape) (para. 10, lines 14-15 and 
line 20 of Hymel), a MIDI player (MIDI player is a type of audio 
player, MP3 player is merely an example) (para. 10, lines 14-15 
and line 19 of Hymel), a cellular telephone (para. 10, lines 14- 
15 of Hymel), and/or a world wide web display (figure 1(130) and 
para. 11, lines 1-10 of Hymel) . 

Sugiyama in view of Chino is combinable with Hymel because 
they are from similar problem solving areas, namely the control 
of data storage and output. At the time of the invention, it 
would have been obvious to a person of ordinary skill in the art 
to configure said user interface so that the user interface 
allows a user to control a compact disc (CD) device, a digital 
video disc (DVD) device, an audio tape device, a video tape 
device, a MIDI player, a cellular telephone, and/or a world wide 
web display, as taught by Hymel. The motivation for doing so 
would have been to allow a user to connect a variety of 
different types of peripheral devices to an overall system, thus 
allowing the user to perform a variety of functions (para. 2, 
lines 1-6 of Hymel) . Therefore, it would have been obvious to 
combine Hymel with Sugiyama in view of Chino to obtain the 
invention as specified in claims 36-39, 44-45 and 47. 

Regarding claims 51-58, 63, 65, 73 and 75: Sugiyama in 
view of Chino does not disclose expressly that the second output 
device is a DVD drive, CD drive, audio tape drive, video 
cassette device, removable media device, embedded audio 
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recorder, embedded video recorder, non-volatile storage device, 
cellular telephone, world-wide web display, hardware for 
performing audio capture, and/or a disposable media writer. 

Hymel discloses a user interface configured to allow a user 
to control as an output device (para. 10, lines 1-5 of Hymel) a 
DVD drive (para. 10, lines 14-15 and lines 20-21 of Hymel), CD 
drive (para. 10, lines 14-15 and lines 19-20 of Hymel), audio 
tape drive (audio tape drive is a type of audio player, MP3 
player is merely an example) (para. 10, lines 14-15 and line 19 
of Hymel) , video cassette device (digital camcorder, which, as 
is well-known in the art, uses a digital video (DV) cassette 
tape) .(para. 10, lines 14-15 and line 20 of Hymel), removable 
media device (the compact discs used in compact disc devices are 
well-known to be removable media devices) (para. 10, lines 14-15 
and lines 19-20 of Hymel), embedded (para. 10, lines 22-26 of 
Hymel) audio recorder (para. 10, lines 14-15 and line 19 of 
Hymel), embedded (para. 10, lines 22-26 of Hymel) video recorder 
(para. 10, lines 14-15 and line 20 of Hymel), non-volatile 
storage device (compact disc devices and digital video disc 
devices are well-known to be non-volatile storage media devices) 
(para. 10, lines 14-15 and lines 19-21 of Hymel), cellular 
telephone (para. 10, lines 14-15 of Hymel), world-wide web 
display (figure 1 (130) and para. 11, lines 1-10 of Hymel), 
hardware for performing audio capture (as is well-known in the 
art, part of the function of a digital camcorder is to capture 
audio signals, along with the video) (para. 10, lines 14-15 and 
line 20 of Hymel), and/or a disposable media writer (compact 
discs (CD-R's) and digital video discs (DVDiR's) are well-known 
to be disposable media) (para. 10, lines 14-15 and lines 19-21 
of Hymel) . 
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Sugiyama in view, of Chino is combinable with Hymel because 
they are from similar problem solving areas, namely the control 
of data storage and output. At the time of the invention, it 
would have been obvious to a person of ordinary skill in the art 
to have the second output device be a DVD drive, CD drive, audio 
tape drive, video cassette device, removable media device, 
embedded audio recorder, embedded video recorder, non-volatile 
storage device, cellular telephone, world-wide web display, 
hardware for performing audio capture, and/or a disposable media 
writer, as taught by Hymel. The motivation for doing so would 
have been to allow a user to connect a variety of different 
types of peripheral devices to an overall system, thus allowing 
the. user to perform a variety of functions (para. 2, lines 1-6 
of Hymel) . Therefore, it would have been obvious to combine 
Hymel with Sugiyama in view of Chino to obtain the invention as 
specified in claims 51-58, 63, 65, 73 and 75. 

16. Claims 40-41, 49, 59-61, 69 and 77 are rejected under 35 
U.S.C. 103(a) as being unpatentable over Sugiyama (US Patent 
5,633,723) in view of Chino (US Patent 6,118,888) and Stevens 

(US Patent Application Publication 2002/0010641 Al) . 

Regarding claims 40-41 and 49: Sugiyama in view of Chino 
does not disclose expressly that said user interface is 
configured to allow a user to control a multimedia server, 
encryption hardware, and/or a radio receiver. 

Stevens discloses a user interface (figure 3(104) of 
Stevens) configured to allow a user to control a multimedia 
server (para. 53, lines 6-10 of Stevens), encryption hardware 

(para. 54, lines 1-9 of Stevens), and a radio receiver (figure 3 

(110) and para. 36, lines 1-8 of Stevens) . 
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Sugiyama in view of Chino is combinable with Stevens 
because they are from the same field of endeavor, namely the 
control and processing of time-based media data. At the time of 
the invention, it would have been obvious to a person of 
ordinary skill in the art to configure said user interface to 
allow a user to control encryption hardware and a radio 
receiver, as taught by Stevens. The motivation for doing so 
would have been to allow users to retrieve desired distributions 
of audio and video data over a controlled broadcast (para. 4, 
lines 1-5 of Stevens) . Therefore, it would have been obvious to 
combine Stevens with Sugiyama in view of Chino to obtain the 
invention as specified in claims 40-41 and 49. 

Regarding claims 59-61, 69 and 77: Sugiyama in view of 
Chino does not disclose expressly that the second output device 
is an embedded multimedia server, audio encryption hardware, 
video encryption hardware, a satellite radio receiver and/or a 
wireless device. 

Stevens discloses controlling as an output device an 
embedded multimedia server (para. 53, lines 6-10 of Stevens), 
audio encryption hardware (para. 54, lines 1-4 and para. 57, 
lines 3-4 of Stevens), video encryption hardware (para. 54, 
lines 1-4 of Stevens), a satellite radio receiver (para. 36, 
lines 1-6 of Stevens), and/or a wireless device (para. 36, lines 
1-6 of Stevens) . As is well-known in the art, a satellite radio 
receiver is a type of wireless device. 

Sugiyama in view of Chino is combinable with Stevens 
because they are from the same field of endeavor, namely the 
control and processing of time-based media data. At the time of 
the invention, it would have been obvious to a person of 
ordinary skill in the art to have the second output device be an 
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embedded multimedia server, audio encryption hardware, video 
encryption hardware, and/or a satellite radio receiver, as 
taught by Stevens. The motivation for doing so would have been 
to allow users to retrieve desired distributions of audio and 
video data over a controlled broadcast (para. 4, lines 1-5 of 
Stevens) . Therefore, it would have been obvious to combine 
Stevens with Sugiyama in view of Chino to obtain the invention 
as specified in claims 59-61, 69 and 77. 

17. Claims 46, 64, 66-68 and 71 are rejected under 35 U.S.C. 
103(a) as being unpatentable over Sugiyama (US Patent 5,633,723) 
in view of Chino (US Patent 6,118,888), Stevens (US Patent 
Application Publication 2002/0010641 Al) , and McCarthy (US 
Patent 6, 296, 693 Bl) . 

Regarding claim 46: Sugiyama in view of Chino does not 
disclose expressly that said user interface is configured to 
allow a user to control a two-way radio. 

Stevens discloses a user interface (figure 3(104) of 
Stevens) configured to allow a user to control a radio receiver 
(figure 3(110) and para. 36, lines 1-8 of Stevens). 

Sugiyama in view of Chino is combinable with Stevens 
because they are from the same field of endeavor, namely the 
control and processing of time-based media data. At the time of 
the invention, it would have been obvious to a person of 
ordinary skill in the art to configure said user interface to 
allow a user to control a radio receiver, as taught by Stevens. 
The motivation for doing so would have been to allow users to 
retrieve desired distributions of - audio and video data over a 
controlled broadcast (para. 4, lines 1-5 of Stevens) . 
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Therefore, it would have been obvious to combine Stevens with 
Sugiyama in view of Chino. 

Sugiyama in view of Chino and Stevens does not disclose 
expressly that said radio is specifically a two-way radio. 

McCarthy discloses using a two-way (CB) radio (column 7, 
lines 13-16 and lines 21-23 of McCarthy) . 

Sugiyama in view of Chino and Stevens is combinable with 
McCarthy because they are from similar problem solving areas, 
namely the control of data communication hardware. At the time 
of the invention, it would have been obvious to a person of 
ordinary skill in the art to provide for user control of a 
radio, as taught by Stevens, wherein said radio is specifically 
a two-way radio, as taught by McCarthy. The motivation for 
doing so would have been to provide the user with means of 
personal communication. Therefore, it would have been obvious 
to combine McCarthy with Sugiyama in view of Chino and Stevens 
to obtain the invention as specified in claim 46. 

Regarding claims 64, 66-68 and 71: Sugiyama in view of 
Chino does not disclose expressly that the second output device 
is a two-way radio, a radio receiver for receiving AM signals, a 
radio receiver for receiving FM signals, a radio receiver for 
receiving short wave radio signals, and/or an emergency alert 
monitor for receiving emergency broadcast system alerts. 

Stevens discloses controlling as an output device a radio 
receiver (para. 36, lines 1-6 of Stevens). 

Sugiyama in view of Chino is combinable with Stevens 
because they are from the same field of endeavor, namely the 
control and processing of time-based media data. At the time of 
the invention, it would have been obvious to a person of 
ordinary skill in the art to have the second output device be a 
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radio receiver, as taught by Stevens. The motivation for doing 
so would have been to allow users to retrieve desired 
distributions of audio data over a controlled broadcast (para, 
4, lines 1-5 of Stevens) . Therefore, it would have been obvious 
to combine Stevens with Sugiyama in view of Chino. 

Sugiyama in view of Chino and Stevens does not disclose 
expressly that said radio receiver is a two-way radio, a radio 
receiver for receiving AM signals, a radio receiver for 
receiving FM signals, a radio receiver for receiving short wave 
radio signals, and/or an emergency alert monitor for receiving 
emergency broadcast system alerts. 

McCarthy discloses output devices including a two-way (CB) 
radio (column 7, lines 13-16 and lines 21-23 of McCarthy), a 
radio receiver for receiving AM signals (column 7, lines 13-16 
and lines 20-21 of McCarthy) , a radio receiver for receiving FM 
signals (column 7, lines 13-16 and lines 20-21 of McCarthy), a 
radio receiver for receiving short wave radio signals (column 7, 
lines 13-16 and lines 21-23 of McCarthy), and/or an emergency 
alert monitor for receiving emergency broadcast system alerts 
(column 7, lines 13-16 and lines 18-20 of McCarthy) . 

Sugiyama in view of Chino and Stevens is combinable with 
McCarthy because they are from similar problem solving -areas, 
namely the control of data communication hardware. At the time 
of the invention, it would have been obvious to a person of 
ordinary skill in the art to provide for user control of a 
radio, as taught by Stevens, wherein said radio is specifically 
a- two-way radio, a radio receiver for receiving AM signals, a 
radio receiver for receiving FM signals, a radio receiver for 
receiving short wave radio signals-, and/or an emergency alert 
monitor for receiving emergency broadcast system alerts, as 
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taught by McCarthy. The motivation for doing so would have been 
to provide the user with means of personal communication. 
Therefore, it would have been obvious to combine McCarthy with 
Sugiyama in view of Chino and Stevens to obtain the invention as 
specified in claims 64, 66-68 and 71. 

18. Claim 48 is rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sugiyama (US Patent 5,633,723) in view of 
Chino (US Patent 6,118,888) and Wedekind (US Patent 5,115,967). 

Regarding claim 48: Sugiyama in view of Chino does not 
disclose expressly that said user interface is configured to 
allow a user to control a climate sensor. 

Wedekind discloses computer control (column 4, lines 53-58 
of Wedekind) of a climate sensor (column 5, lines 3-9 of 
Wedekind) . 

Sugiyama in view of Chino is combinable with Wedekind 
because they are from the same field .of endeavor, namely the 
control and processing of time-based data. At the time of the 
invention, it would have been obvious to a person of ordinary 
skill in the art to configure said user interface to allow a 
user to control a climate sensor, as taught by Wedekind. The 
motivation for doing so would have been to control the overall 
climate of the room or building in which the printer system user 
is located. Therefore, it would have been obvious to combine 
Wedekind with Sugiyama in view of Chino to obtain the invention 
as specified in claim 48. 

19. Claim 70 is rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sugiyama (US Patent 5, 633, 723) ■ in view of 
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Chino (US Patent 6,118,888) and Rowe (US Patent Application 
Publication 2001/0003846 Al) . 

Regarding claim 70: Sugiyama in view of Chino does not 
disclose expressly that the second output device is a weather 
alert receiver. 

Rowe discloses controlling as an output device a weather 
alert receiver (para. 62, lines 3-6 of Rowe). 

Sugiyama in view of Chino is combinable with Rowe because 
they are from the same field of endeavor, namely the control and 
processing of time-based media data. At the time of the 
invention, it would have been obvious to a person of ordinary 
skill in the art to use a weather alert receiver as an output 
device, as taught by Rowe. The suggestion for doing so would 
have been that weather alert data is simply another form of 
useful multi-media data that a user may wish to obtain. 
Therefore, it would have been obvious to combine Rowe with 
Sugiyama in view of Chino to obtain the invention as specified 
in claim 70. 

20. Claim 72 is rejected under 35 U.S.C. 103(a) as being 
unpatentable over Sugiyama (US Patent 5,633,723) in view of 
Chino (US Patent 6,118,888) and Abgrall (US Patent 6,373498 Bl). 

Regarding claim 72: Sugiyama in view of Chino does not 
disclose expressly that the second output device is a weather 
alert receiver. 

Abgrall discloses controlling as an output device hardware 
for performing VGA screen captures (column 12, lines 6-8 of 
Abgrall) . 

Sugiyama in view of Chino is combinable with Abgrall 
because they are from the same field of endeavor, namely the 
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control and processing of time-based media data. At the time of 
the invention, it would have been obvious to a person of 
ordinary skill in the art to use hardware to perform VGA screen 
captures, as taught by Abgrall. The suggestion for doing so 
would have been that a VGA screen capture is simply another form 
of useful multi-media data that a user may wish to obtain. 
Therefore, it would have been obvious to combine Abgrall with 
Sugiyama in view of Chino to obtain the invention as specified 
in claim 72 . 


Any inquiry concerning this communication or earlier 
communications from the examiner should be directed to James A. 
Thompson whose telephone number is 571-272-7441. The examiner 
can normally be reached on 8 : 30AM- 5 : 00PM. 

If attempts to reach the examiner by telephone are 
unsuccessful, the examiner's supervisor, David K. Moore can be 
reached on 571-272-7437. The fax phone number for the 
organization where this application or proceeding is assigned is 
571-273-8300. 

Information regarding the status of an application may be 
obtained from the Patent Application Information Retrieval 
(PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, 
see http://pair-direct.uspto.gov. Should you have questions on 
access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free) . 
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